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ABSTRACT 

The non-Euclidean geometry of spacetime induces an anisotropy in the 
apparent correlation function of high-redshift objects, such as quasars, if 
redshifts and angles are converted to distances in "naive" Euclidean fashion. 
The degree of angular distortion depends on cosmological parameters, especially 
on the cosmological constant A, so this effect can constrain A independent of 
any assumptions about the evolution of luminosities, sizes, or clustering. We 
examine the prospects for distinguishing between low-density (Q = 0.1 — 0.4) 
cosmological models with flat and open space geometry using the large quasar 
samples anticipated from the Two Degree Field Survey (2dF) and the Sloan 
Digital Sky Survey (SDSS). Along the way, we derive a number of results that 
are useful for studies of the quasar correlation function. In particular, we show 
that even these large quasar surveys are likely to reside in the "sparse sampling" 
regime for correlation function measurements, so that the statistical fluctuations 
in measurements are simply the Poisson fluctuations in the observed numbers of 
pairs. As a result: (a) one can devise a simple maximum-likelihood scheme for 
estimating clustering parameters, (b) one can generate Monte Carlo realizations 
of correlation function measurements without specifying high-order correlation 
functions or creating artificial quasar distributions, and (c) for a fixed number of 
quasars, a deeper survey over a smaller area has greater statistical power than a 
shallow, large-area survey. If the quasar correlation length is equal to the value 
implied by recent (quite uncertain) estimates, then the 2dF and SDSS samples 
can provide clear discrimination between flat and open geometries for Q < 0.2 
but only marginal discrimination for Q = 0.4. Clear discrimination is possible 
for Q = 0.4 if the true quasar correlation length is a factor of two larger, and 
a high-density survey of 30,000 quasars in 200 square degrees would provide 
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clear discrimination even for the lower correlation length. Detection of quasar 
clustering anisotropy would confirm the cosmological spacetime curvature that 
is a fundamental prediction of general relativity. 

Subject headings: quasars: general, large-scale structure of Universe 
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1. Introduction 

In cosmological models that obey General Relativity and the cosmological principle, 
the mass density parameter, Q, and the cosmological constant, A, together determine 
the geometry of spacetime. The Einstein-de Sitter (fl — 1) model has twin virtues of 
simplicity: flat spatial geometry and zero cosmological constant. However, the ages of 
globular cluster stars, the high baryon fraction in galaxy clusters, and some aspects of large 
scale galaxy clustering are accounted for more easily in low density models, which have 
flat geometry if A = Ac 2 /3Hq = 1 — Q [], or open, negative curvature geometry if A = 0. 
Dynamical studies of large scale structure can constrain f2o (subject to uncertainties about 
biased galaxy formation), but they are insensitive to a cosmological constant because it 
represents an unclustered energy component. This paper examines the prospects for using 
the anisotropy of the quasar correlation function to constrain Qq and Ao, in particular to 
distinguish between flat and open cosmologies. While this test is impractical with present 
quasar samples, the Anglo- Australian 2-degree Field Survey (hereafter 2dF) and the Sloan 
Digital Sky Survey (hereafter SDSS or Sloan) will both produce redshift samples of several 
tens of thousands of quasars over the next few years. 

Classical methods of measuring spacetime geometry rely on standard candles or 
standard rulers, and they are therefore subject to systematic uncertainties in the evolution 
of these objects over a large range in redshift. Alcock & Paczyhski (1979) proposed an 
alternative approach that is almost entirely independent of evolution and assumes only that 
structure in the universe is statistically isotropic, as implied by the cosmological principle. 
At high redshift, the ratio of distances corresponding to a given redshift separation Az 
and angular separation A6 depends on the spacetime metric, and one can constrain the 

Subscript 'zero' indicates the value of the parameters at the present epoch. Also, we use 
the notation Hq = ho • 100 km s -1 Mpc -1 
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cosmo logical parameters by requiring that they yield isotropic structure. 

Alcock & Paczyhski (1979) illustrated their suggestion with the idealized example of 
spherical clusters, but nature does not provide us with such convenient objects of study. 
Ryden (1995a) suggested using the statistical distribution of void shapes in deep galaxy 
redshift surveys like the SDSS, but it is not clear that even this million galaxy sample 
will be sufficient to detect the effect; it does not extend much beyond z ~ 0.2, and at this 
depth the geometrical distortion of voids is difficult to separate from distortions induced by 
galaxy peculiar velocities (Ryden & Melott 1996). While quasar redshift surveys have fewer 
tracers, they reach to much higher redshifts, where the expected geometrical anisotropy 
is more pronounced. Thus Phillips (1994) suggested using the orientations of neighboring 
quasar pairs to implement Alcock & Paczyhski's method. The 2-point correlation function 
contains statistical information on the distribution of all quasar pairs, not just nearest 
neighbor pairs, so it is a more powerful measure for detecting distortions of geometry. It is 
important to note that these distortions are detectable only because quasars are clustered. 
If quasars were Poisson distributed, then all pair orientations would be statistically isotropic 
regardless of the assumed metric. 

Two recent papers (Ballinger, Peacock & Heavens 1996; Matsubara & Suto 1996; see 
also Nakamura, Matsubara, & Suto 1997) have discussed the use of redshift space clustering 
in quasar samples as a tool for constraining Q and A . Matsubara & Suto (1996) derive an 
expression for the correlation function that includes the effects of geometrical distortion and 
linear theory peculiar velocities. Ballinger et al. (1996) derive expressions for the redshift 
space power spectrum, including effects of geometrical distortion, linear theory peculiar 
velocities, and incoherent random velocities generated by small scale collapse. 

In the next section, we discuss the geometrical distortion of the correlation function 
in the absence of peculiar velocities, extending the calculation of Phillips (1994). The 
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distortion due to geometry alone is simple to understand: changes in the metric just alter 
the relation between a (Az, A8) separation and the corresponding physical distance. In §3 
we show that, for realistic quasar samples, measurement errors in the correlation function 
are likely to be dominated by Poisson fluctuations in the number of quasar pairs. As a 
result, we can easily create Monte Carlo realizations of correlation function measurements 
for a specified model correlation function. In §4 we use such Monte Carlo experiments to 
see what cosmological constraints can be expected from the 2dF and Sloan quasar samples. 
In §5 we summarize the results of these experiments and discuss some of their limitations. 
The most serious of these is probably our neglect of peculiar velocity distortions in modeling 
the correlation function, but we argue in §5 that these are unlikely to overwhelm the 
geometrical signal. A full analysis of observational data will require joint consideration of 
velocity and geometry effects, along the lines envisioned by Ballinger et al. (1996). 

2. The redshift space correlation function 

The position of a quasar in redshift survey data is characterized by three numbers: 
the redshift and two angle coordinates on the sky (z,0 r ,(f> r ). For a given quasar, the 
probability of finding a neighbor in a given volume element is symmetric about the line of 
sight, since this is the only preferred direction. For any pair of quasars one can therefore 
find a transformation (<p r ,0 r .) — > ((f), 0) such that 0i = 02 m the new frame of reference. 
Consequently, the distance between the points in redshift space can be described in terms 
of redshift z and angle 8. 

Figure 1 shows the situation with quasars at the positions (zi,0i) and (z 2 ,02). We 
define s z = z<i — z\, sq = z • (62 — Q\) = z ■ AO, with z — (z\ + 2*2)/ 2 assumed to be much 
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greater then z 2 — Z\. We now adopt the following notation: 



= . c 2 



and 



fi= — 

s 



(2) 



The angular separation can then be expressed as 



Ae 2 = z- 2 s 2 z (fi- 2 -i). 



(3) 



In Euclidean geometry, s z and sg would be the line-of-sight and transverse separations, 
respectively (in dimensionless, redshift units); s would be the 3-dimensional separation, and 
/i would be the cosine of the angle between the separation vector and the line of sight. In 
reality the geometry is not Euclidean, but we can still keep the formal definitions of s and 
\i introduced above. 

Adopting Phillipps' (1994) notation we have 



r 2 = fA6 2 + g 2 sl , 



(4) 



where in general (e.g., Weinberg 1972) 
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and 



c 



1 



(6) 




Q (1 + zf + (1 - fio - A )(l + zf + A 



Combining equations (p]), (0), (|]) and we find 
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2 + h 2 (l — fi 2 ) , where h 
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Now suppose that the quasars are clustered and that their correlation function £(r) is 
described by power-law, 



where, in principle, the correlation length r and the index 7 may be functions of z. In 
redshift space, the correlation function at vector separation (s,/i) is simply the value of £(r) 
at the scalar separation r corresponding to s, \i. Substitution of (0) into (|S]) yields 



where So = vq/ g. The correlation function in these coordinates is anisotropic because the 
physical separation corresponding to a given s depends on angle with respect to the line 
of sight. The anisotropy is stronger when 7 is larger because a given change in r then 
produces a larger change in £(r). 

Once So and 7 are set, the dependence of the correlation function on the geometry 
of the universe is determined entirely through the value of the "distortion parameter" h. 
Figure 2 shows the redshift dependence of h(z) for open and flat cosmologies with various 
Qq . The functional form of h(z) depends much more strongly on Ao than on Qq , implying 
that clustering anisotropy can much more easily distinguish models with the same Qq and 






(9) 
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different Ao than models with similar Ao and different Qq, as Alcock & Paczyhski (1979) 
pointed out. There is also an approximate degeneracy in h(z) between open models with 
low Qq and flat models with relatively high Qq. 

In the range 1 < z < 5, h(z) can be well approximated by a straight line for most 
models. The anisotropy increases with redshift in all cases, but models can in principle be 
distinguished both by the value of h at a given z and by the overall redshift dependence of 
h(z). As discussed in the following sections, in a real redshift survey the information for 
distinguishing cosmologies comes mainly from the redshifts where the quasar distribution 
peaks, since that is where the clustering can be measured most precisely. 

Figure 3 shows the angular dependence of the correlation function, from equation @, 
for various values of h. If h — 1, the geometry of redshift space is Euclidean, and there is 
no correlation function anisotropy. All models have h ~ 1 at z <C 1, and the Ao = 1, = 
model has h(z) = 1 at all redshifts. For other models h(z) > 1 at high redshifts, and the 
correlation function is amplified^ for pair separations along the line of sight = 1) relative 
to pair separations perpendicular to the line of sight. The anisotropy of the correlation 
function increases rapidly with increasing h. 



2 Whether one sees "amplification" or "suppression" depends on the choice of reference 
model. Here our reference is Euclidean (Ao=l), but Ballinger et al. (1996) take Qq =1 as 
a reference and therefore find that alternative models have suppressed clustering along the 
line of sight. 



-10- 



3. Statistical errors in measurements of £(s,/i) 

Following Peebles (1980, §31), we can define a quasar's average number of "clustered 
neighbors" by 

N c = / <(r)4vrr 2 dr, (10) 



where n is the space density of quasars in a sample. For purposes of calculation, we assume 
a power-law correlation function (equation ||). Since the correlation function may fall 
below this power-law at large distances, we only consider pairs out to a separation aro that 
is a small multiple a of the correlation length. Substitution of into fllPf) yields 

N c = nrl (11) 

We will take a = 2 as a template value in our simulations. For a = 2, the value of N c from 
flnp varies by only 5% for 1 < 7 < 2. 

Consider a sample of Nq quasars in an area A square degrees, and let F(z)dz denote 
the fraction of the quasar sample in the redshift range (z, z + dz), normalized so that 
Jq 00 F(z)dz = 1. The observations directly tell us (Nq/A)F(z), the average number of 
quasars per square degree per unit redshift. The relation between (Nq/A)F(z) and the 
number density n(z) in comoving h -3 Mpc 3 depends on the cosmological model. Since the 
volume of a redshift range dz and solid angle dQ is g dz ■ f 2 dQ, 

_ = 3283(WM (12) 

gr 

where 3283 is the number of square degrees per radian. For compactness, in this and future 
equations we generally omit the explicit ^-dependence of n, /, and g. From (|5|) and (|(J) it 
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is clear that both / and g involve the factor cH Q 1 = 3000h 1 Mpc, and it is convenient to 
write them in the form 



/ = Tp/, and g = —g. (13) 

-no -"0 

We use the notation ( |T3"D and the value of cHq 1 to write ( |T2"D as 

n = 1.21 • 10' 7 -f-F{z)g~ 1 f~ 2 hg Mpc~ 3 (comoving). (14) 
Substitution of QUI) into (|TT| ) gives 

N c (z) = ^^rl (l.21 ■ lO-^F(z)r7- 2 ) , (15) 

for r in comoving h^ 1 Mpc. The number of correlated pairs in the range (z, z + dz) is 

N 2 

N pairs (z) = N Q F(z)N c (z) ex -fF 2 {z)rl. (16) 

As a fiducial case let us take a = 2, 7 = 2, N Q = 10 5 , A = 10 4 D°, and F(z) = 0.5. 
Then 

"•M^isfeRw)' (17) 

where r is the comoving correlation length. We have scaled g -1 / 2 to the value for an 
f2 =1 model at z = 2. Substitution of fll7D into (0) yields 



10h _1 Mpcy v 7 - 27 



iW*) = 5500 — _° — ) [^-1 (18) 



for the number of correlated quasar pairs expected in an interval Az « 1 near the peak of 
the redshift distribution in a large quasar redshift survey. 



-12- 



We now come to the central issue of this Section — a key issue for the entire paper, in 
fact — the nature of statistical fluctuations in estimates of the correlation function. In the 
limit N c ^$> 1, the statistical uncertainty is dominated by the finite number of independent 
structures in the survey volume, an effect sometimes referred to as "cosmic variance." As a 
conceptual toy model, one can imagine the structure to consist of clusters with an average 
of N c members apiece. Each cluster is sampled by many correlated pairs, so the fluctuation 
in the number of clusters within the survey dominates the error in £. In the opposite limit, 
N c <C 1, most clusters are not "detected" with even a single correlated pair, and it is the 
Poisson fluctuation in the number of pairs that dominates the statistical error rather than 
the fluctuation in the number of independent structures. In this "sparse sampling" or 
"Poisson limit," the error in an estimate of £(s,/x) in a bin (As, A/x) is simply the Poisson 
error in the number of pairs in the bin, and the errors in separate bins are statistically 
independent. The transition between the dense sampling and sparse sampling limits occurs 
at N c ~ 1; we have carried out numerical experiments with Monte Carlo clustering models 
(Soneira & Peebles 1978) to confirm that the Poisson error approximation holds quite 
accurately for N c ^ 1. 

In a typical galaxy redshift survey, N c (z) ^> 1 nearby, and N c (z) drops below one at 
large distances, where only the most luminous galaxies lie above the survey's apparent 
magnitude limit. Roughly speaking, the volume within which N c (z) ^ 1 is the effective 
volume of the survey for purposes of estimating £; there is some usable information from 
larger distances, but as the structure "fades out" under increasingly sparse sampling, the 
statistical significance of this additional information drops. 

Equation ([17]) implies that even an ambitious quasar redshift survey is likely to be in 
the sparse sampling regime at all redshifts, unless the comoving quasar correlation length is 
substantially larger than IOIiq 1 Mpc. This result has several important implications. First, 
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the independent, Poisson errors in £ allow a straightforward maximum-likelihood scheme 
for estimating correlation function parameters. We describe this scheme in §4.3 below; this 
method was developed independently by Croft et al. (1997), who applied it to rich galaxy 
clusters, and it was applied to a sample of high-redshift quasars from the Palomar Transit 
Grism Survey by Stephens et al. (1997). A second implication is that, given a theoretical 
prediction of £(s, /z), one can generate Monte Carlo realizations of measured correlation 
functions for a given sample without creating detailed realizations of a clustering pattern, 
because the fluctuation in a measured value of £ depends only on the expected number of 
pairs and is independent of fluctuations in other bins and of the higher-order clustering 
properties of the quasar distribution. We describe this method for creating Monte Carlo 
realizations in §4.2 below, and in §4.4 we use it to evaluate the power of the SDSS and 
2dF quasar redshift surveys for constraining the cosmo logical constant. Finally, there is an 
observational implication: for a fixed number of quasars, a deeper survey over a smaller 
area has greater statistical power, at least for measurements of the correlation function on 
scales ~ r . 

This last point is demonstrated most clearly by generalizing equations (|T7|) and (|H|) to 

- 55 oo p/i^) ^ (gg) ^ m 

If N c (z) <^ 1, then the effective signal for correlation function measurements is set by 
N P airs{z), since each correlated pair contributes non- redundant information. At fixed 
surface density Nq/A, this signal increases in proportion to the number of quasars Nq, 
but at fixed area A it is proportional to Nq. Of course, increasing Nq at fixed A usually 
requires one to observe fainter quasars, while increasing Nq at fixed surface density does 
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not. Equation (|20|) also implies that the precision of correlation function measurements will 
be peaked sharply near the maximum of the survey's redshift distribution F(z) and that 
the precision attained will depend strongly on the actual value of the quasar correlation 
length r . 

The remaining equations in this Section are not fundamental, but they are needed for 
our Monte Carlo simulations and maximum-likelihood parameter estimation, and we include 
their derivation for the convenience of others who may wish to pursue similar approaches. 
A physical model specifies the correlation function in real space (r-space), but a redshift 
survey provides data in redshift space (s-space). The relation between coordinates in these 
two complementary descriptions is 

/ a„ \ ( dr dr \ ( 




(9(cos t) djcos t) 

V ds dfi 




(21) 



where cost = gs z /r. Thus 



drd(cost) = detA dsdfx. 



(22) 



A short calculation leads to 



d(cost) 



h 2 dji 



[W- (h 2 -l)n 2 ]* 



and 



(23) 



dr = gJ h 2 — {h 2 — l)/z 2 ds 



Since ®( c ° st ^ = o, equation (|22| ) yields 



(dV) r = -2irr 2 drd(cost) = -2vrr 5 



gsfi(h 2 — l)dti 
h 2 - {h 2 - l)/i 2 



dr d(cost) 
ds dji 



dsdfi 



(24) 



(25) 



- 15 - 

for the volume element in real space. Substitution of ( f23|) & (^4j) into ( p5|) leads to 

(dV) r = g 3 h 2 (-2ns 2 dsdiJ,) = g 3 h 2 (dV) S} (26) 

where (dV) s is the volume element in redshift space. The number of quasars in a given 
region will be the same regardless of the adopted coordinate system. Thus 

n s (dV) s = n(z)(dV) r , (27) 

where n s and n(z) are number densities of quasars in redshift and real spaces, respectively. 
Combining (|26|) and (|27j) leads to 



n a (s,n) = g\z)h 2 {z)n{z). (28) 

The number of pairs expected in an infinitesimally small bin in (s, fi) within the finite 
redshift range (z, z + Az) is 

dN pairs = N(z, z + Az)n s [l + ^(s, fi)](-27is 2 dsdfi) J (29) 

where N(z, z + Az) is the number of observed quasars in this redshift range. Since F(z)dz 
is the fraction of quasar redshifts in an infinitesimal range dz, 

N(z } z + Az) = Nq £ +AZ F(z)dz } (30) 

where Nq is the total number of quasars in the sample. Substitution of (|9|), (p^) and (|30|) 
into (|29|) for infinitesimally small Az = dz yields 



s 



-7r 



dN pairs = -2TrN Q g i h z nF{z) \ 1 + ( — ) fi 2 + h 2 {l - /i 2 ) 2 \ s 2 dzdsdfM. (31) 



71 
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Here Sq = r /g is the line-of-sight separation that corresponds to the comoving correlation 
length r , and the mean number density n is given in terms of Nq, A, and F(z) by 
equation (|T4l) . The quantities g, /i, and n all depend on redshift, and so and 7 may depend 
on redshift also. 



4. Monte Carlo experiments 

4.1. Observational perspective 

Successful measurement of quasar clustering anisotropy will require redshift samples 
much larger than those that exist today. There are two clear prospects for such samples, the 
SDSS and a quasar redshift survey using the 2dF fiber spectrograph on the Anglo-Australian 
Telescope. The SDSS plans to obtain redshifts for 80,000 quasars in an area of 5,000 square 
degrees in the North Galactic Cap. It will also measure redshifts for ~ 20, 000 quasars 
in the surrounding 5,000 square degree "skirt," but this subset will be less useful for 
clustering measurements because of its lower density. The SDSS will also conduct a deeper 
quasar survey in a stripe of ~ 200 square degrees in the South Galactic Cap, to a limiting 
magnitude yet to be determined. (A discussion of the planned SDSS quasar survey can be 
found at |http://www.astro.princeton.edu/BBOOK/SGlElNGE/gU ASARS/quasars.htmlQ 



The SDSS will select quasar candidates based on 5-band CCD photometry. The planned 
2dF survey will target ~ 30, 000 quasars in an area ~ 750 square degrees, selected as 
UV-excess stellar objects on scanned photographic plates (Shanks, private communication). 

In order to generate Monte Carlo realizations of correlation function measurements 
from these samples, we need to know (approximately) the expected redshift distributions 
F(z). We have computed these using the observational determinations of the quasar 
luminosity function by Boyle (1991) and Warren, Hewett, & Osmer (1994). The Boyle 
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(1991) results are based on the Boyle, Shanks & Peterson (1988) survey of quasars selected 
by the UV-excess method, which is effective mainly for z <; 2.2. The Warren et al. (1994) 
results are based on a multicolor survey and probe the redshift range 2.0 < z < 4.5. 
For our calculations, we assume that the 2dF survey will contain quasars only up to 
z = 2.2, because of its UV-excess selection technique, and that the SDSS multi-color 
selection will identify quasars at all redshifts, with apparent magnitude being the only 
important limit. We find that the planned SDSS and 2dF surface densities imply limiting 
apparent magnitudes of roughly B = 19.6 and B = 21.4, respectively. With these apparent 
magnitude limits, we compute the number of quasars per square degree per unit redshift 
from the above-mentioned luminosity functions. 

The solid curves in the two panels of Figure 4 show the results of these calculations. 
Sharp dips at z ~ 2 — 2.2 are an artifact of using the Boyle (1991) luminosity function close 
to the redshift limit of the Boyle et al. (1988) survey. More broadly, the shapes of these 
curves reflect the interplay between the peak in the quasar luminosity function at z ~ 2 — 3 
and the smaller fraction of the luminosity function that is visible above the apparent 
magnitude limit at larger distances. Of course, F(z) is also affected by the increase of 
the differential volume element dV/dz with z, especially at low redshift. Up to z ~ 2, the 
evolution effects and the magnitude limit work in different directions, producing a relatively 
flat redshift distribution. Above z ~ 2 both the number density of quasars and our ability 
to see them decreases, and the redshift distribution drops rapidly towards zero. 

Since these calculated redshift distributions are only approximate — the quasar 
luminosity function is itself uncertain, and we have not modeled the selection criteria and 
corresponding incompleteness of the two surveys in any detail — we fit them with simple 
analytic forms to use in our Monte Carlo calculations below. These fits are indicated by the 
dashed curves in Figure 4. The survey's target selection algorithms will probably focus on 
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objects with point-source morphology in order to reduce contamination by galaxies. This 
selection technique may exclude quasars at low redshift, where the host galaxies are bright 
enough to be detected as extended emission. In our F(z) fits, we model this effect by a 
sharp cutoff at z < 0.4. 

4.2. Generating Monte Carlo simulations 

For our Monte Carlo experiments, we wish to generate realizations of measured 
redshift-space correlation functions £(s, /x) for various cosmological models and quasar 
survey parameters. We consider two classes of cosmological models: flat models with 

+ =1, and open models with Ao =0. The f2 =1, Einstein-de Sitter cosmology is 
a limiting case of both families. We assume that the real-space quasar correlation function 
is a power-law, £(r) = (r/ro) - ^, out to 2r . Once the cosmological model, the correlation 
function parameters, and the quasar survey parameters are set, the expected number of 
pairs in a separation/redshift bin dsdfidz is given by equation (|3"T|). 

Because the sparseness of the quasar distribution puts us in the Poisson limit (see 
§3), we are able to generate realizations of the measured £(s,/i) very simply, without 
creating artificial spatial distributions. Given the expected number of pairs in a bin from 
equation (|3T|), the number of pairs in a Monte Carlo realization is a random deviate 
drawn from a Poisson distribution with this mean value. The pair numbers for each bin 
can be generated independently. In practice we use 20 logarithmic bins in s, starting at 
O.lso and going up to 2so- We use 5 equal bins in /z; because these bins are large, we 
compute the predicted number of pairs by numerical integration over the bin. We work 
with redshift bins Az = 0.15, implying 12 bins for simulations with a 2dF-like F(z) and 22 
bins for simulations with an SDSS-like F(z). We perform simulations for seven cosmological 
models: flat and open low-density models with Qq = 0.1,0.2,0.4, and the Einstein-de 
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Sitter cosmology, Q = 1. To fully specify the theoretical model, we must also specify the 
correlation length s an d the index 7 as functions of redshift. Existing observations provide 
only weak constraints on 7. We adopt 7 = 2, close to the index 7 = 1.8 of the galaxy 
correlation function, and we assume that 7 is independent of redshift. 

Even the quasar correlation length sq is poorly known at present, because the 
sparseness of the quasar distribution in current samples makes measurements of the quasar 
correlation function very noisy. The best existing study is probably that of Shanks & 
Boyle (1994, hereafter SB), who combine data from three quasar redshift surveys. For 
an Qq — 1, Ao =0 cosmology, they find that their correlation function measurements 
are consistent with a quasar correlation length r$ = 6hg 1 Mpc that remains constant in 
comoving coordinates, implying 

s = — = 0.002(1 + z) 3/2 , (32) 
9 

where we use equation (|) for g(z). 

In order to scale the SB results to other cosmological models, we note that the property 
of the correlation function most robustly constrained by observations is the total number of 
correlated pairs. From equation (p0|), we see that the number of correlated pairs is 

N pairs (z) cc ex jf- oc f| , (33) 

where we have dropped the factors that are independent of the spacetime geometry. For 
alternative cosmological models, we therefore wish to hold the combination s^/h 2 equal to 
the value implied for the VLq = 1, Ao = 0, r = 6hg 1 Mpc model that fits the SB data. We 
therefore adopt 

s (z,tt ,A ) = 0.002(1 + ^)5 



h(z, ^0 , Ap) 
h(z,Sl= 1, A = 0) 



(34) 



-20- 



as a fiducial redshift-space correlation length for our simulations. 



4.3. Maximum likelihood determination of parameters 

Given a simulated or observed set of correlation measurements, we are interested in 
estimating the true correlation function parameters and the parameters of the underlying 
cosmological model. Suppose that the data consist of pair counts iVj in i bins, where i 
may in fact represent a multidimensional (e.g. s, //) space. We have a model M. for the 
correlation function that may depend upon several parameters, e.g. -M(s , 7, f2o , Ao ). This 
model predicts a number of pairs in each bin Ai = nVi(l + £(sj, (J>i))NQ, where V* is the bin 
volume. In the Poisson limit N c <^ 1, which is expected to hold for realistic quasar surveys 
(see §3), the probability of detecting iVj pairs in bin i when Ai are expected is 

P -Ai . ANi 

P(N t \A*) = m 1 ■ (35) 

The probabilities for separate bins are independent, so the overall likelihood C of obtaining 
the data given the model is 

C = P(D\M) = H m 1 , (36) 
implying 

ln(£) = + N t \n A t - In JVj!). (37) 

Since the data Ni are independent of the model parameters, one can find the maximum 
likelihood model by maximizing the quantity 



hiC'(M) = Y l (N i ]n Ai - A^. 

i 



(38) 
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The relative likelihood of two models M.\ and A4 2 is simply exp(ln£ (.Mi) — ln£'(.M2)). 

Although our focus in this paper is on constraining Ao , the maximum-likelihood 
technique outlined here is quite general. For a specified cosmology, one can use this 
technique to estimate correlation function parameters in a way that makes maximum use 
of the available data (e.g., Stephens et al. 1997), and the method can easily be extended 
to incorporate parametrized descriptions of peculiar velocity distortions, evolution of 
clustering, and so forth. The sparse sampling limit is crucial to this approach, for it is 
only this property that makes it possible to write down a straightforward expression for 
the likelihood, equation For a dense sample like a typical galaxy redshift survey, the 

likelihood is a much more complicated function of the model parameters and the data, and 
a maximum-likelihood approach is correspondingly more cumbersome. However, rich galaxy 
clusters do provide a sparse tracer of structure on large scales, and Croft et al. (1997) 
have used the same maximum-likelihood method to estimate parameters of the cluster 
correlation function. 



4.4. Results 

Figures 5-9 present our main results. In Figure 5 we examine the ability of the 2dF 
(left) and SDSS (right) quasar samples to constrain Q in flat, Q + A =1 models. For 
each survey and each value of Qq — 0.1, 0.2, 0.4, and 1, we generated four realizations of 
measured £(s,/z) by the Monte Carlo technique described in §4.2. In all cases we set 7 = 2 
and adopt equation (|34"D for so(z), corresponding to r = 6h _1 Mpc comoving at all z for 
the Qq = 1, Ao =0 model and to Sq(z = 0) = 0.002 in all models. For each realization, 
we then determine the best-fit model parameters by the maximum-likelihood technique 
described in §4.3, computing likelihoods for a grid of open models and a grid of flat models 
with < Qq < 1 and varying values of sq and 7. Squares show the estimated values of 
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Q , denoted Cl , plotted against the true value fltme used to generate the realization. Small 
offsets are added along the VL true axis to improve clarity. Vertical line segments delineate 
the range of VLq values that give likelihood values with 10% of the maximum likelihood; 
this corresponds roughly to a 2a confidence interval for a Gaussian approximation to the 
likelihood distribution. In a few cases — mostly Q = 1 realizations, which are a limiting 
case of both flat and open models — an open model gave a higher likelihood than the 
best-fit flat model. For these cases we plot a filled circle at the value of Cl for the best-fit 
open model. 

In open cosmologies, the anisotropy of the correlation function is only weakly sensitive 
to f2 (see Figure 2), so we do not show the analog of Figure 5 for open models. Even 
with flat models the fl constraints are rather loose, but it is encouraging to see that in 
the Q < 1 models, the Q = 1 model can be rejected on the basis of quasar clustering 
anisotropy alone in nearly every case. 

There are a number of methods to constrain Q from the dynamics of redshift-space 
galaxy clustering (e.g., Kaiser 1987; Carlberg et al. 1996; Kepner, Summers, & Strauss 
1997). These methods suffer from a degeneracy between the density parameter and the 
"bias" of galaxies with respect to mass, but with the high-precision measurements from the 
2dF and Sloan galaxy redshift surveys it should be possible to break this degeneracy and 
measure Q directly. We would then like to use quasar clustering anisotropy to distinguish 
between open (A = 0) and flat (A — 1 — Qo ) cosmologies of known fl ; dynamical 
techniques are insensitive to this distinction because the cosmological constant represents 
an unclustered energy component. 

Figure 6 presents the prospects for such a test. For each realization of each of our 
low-fio models, we compute the likelihood ratio R = C 2 /Ci, where L\ is the likelihood of 
the true model (with the correct values of Q , A , s (z), and 7) and C 2 is the likelihood of 
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the model with the same Qq , Sq(z), and 7 but the incorrect geometry. For Q = 0.1 or 0.2, 
the incorrect geometry can be rejected at > 10 : 1 odds in all of the 2dF realizations and at 
^ 10 : 1 odds in the SDSS realizations. For = 0.4 the difference between geometries is 
smaller, and the incorrect model can only be rejected at ~ 10 : 1 odds or (occasionally) less. 
Since the 2dF and SDSS samples will be independent (with telescopes in the southern and 
northern hemispheres, respectively), a pair of ~ 10 : 1 rejections would constitute a strong 
statistical result. However, there are uncertainties related to peculiar velocity distortions 
and evolution of the correlation function that are not incorporated in our current Monte 
Carlo experiments (see §5 below), so it is not clear that the geometry distinction will be 
possible with these samples for Q > 0.4. 

As equation ( p0| ) demonstrates, the precision with which £(s, /i) can be measured 
depends sensitively on the true quasar correlation length. While the SB estimate is based 
on the most extensive compilation of existing data, it is nonetheless quite uncertain, and 
some other studies have suggested higher values. Stephens et al. (1997), for example, find 
a maximum-likelihood estimate ro = 20hQ X Mpc (comoving, for f2o = 1> A =0) for the 
high-redshift quasars in the Palomar Transit Grism Survey. Figures 7 and 8 repeat the 
Qq -constraint and geometry-discrimination tests for 2dF (Figure 7) and SDSS (Figure 
8) realizations with a correlation length double the value implied by equation (|34J). This 
higher correlation length corresponds to ro = 12ho _1 Mpc comoving for fio = 1> Ao = 0, 
and to sq(z = 0) = 0.004 for all models. 

With the higher correlation length, incorrect geometry models with Qq = 0.4 are 
rejected at ^ 100 : 1 odds in all of the 2dF realizations and all but one of the SDSS 
realizations. With Q < 0.2, the incorrect geometry models are rejected with formal odds 
exceeding 10 6 : 1 in all realizations of both surveys. The f2 determinations in flat models 
are much more precise than those shown in Figure 5 for the smaller correlation length. It 
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is of course possible that the true quasar correlation length is lower than the SB estimate 
instead of higher, in which case the prospects for the clustering anisotropy method would 
be worse than those implied by Figures 5 and 6. The uncertainty in the amplitude of quasar 
clustering is presently the main uncertainty in assessing the power of future quasar surveys 
to constrain cosmological parameters by this approach. 

Figures 5-8 show that the 2dF survey has somewhat greater constraining power than 
the SDSS, even though it has 30,000 quasars instead of 80,000. The high surface density 
of the 2dF sample is crucial to its performance; the factor Nq/A in equation (|20|) for the 
number of correlated pairs is nearly the same for the 2dF and the SDSS. The reason the 
2dF survey does slightly better is its more compact redshift distribution F(z). The SDSS 
has roughly equal numbers of quasars per unit redshift from z = 0.4 to z — 2.2, and a 
significant fraction of the sample lies at z > 2.2. For the 2dF survey, a majority of the 
quasars lie in the range 1 < z < 2.2. The number of correlated pairs per unit redshift is 
proportional to [F(z)] 2 , and the more precise measurement of £(s, /x) at z ~ 2 in the 2dF 
sample wins out over the greater range of redshifts probed by the SDSS. 

As this comparison suggests, the ability of a quasar survey to measure clustering 
anisotropy is sensitive to its details, and there are strategies that can substantially enhance 
this ability for a fixed number of quasars. One possible approach would be to use multi-color 
selection techniques to target quasars in particular redshift ranges, producing peaks in F(z) 
at specific redshifts. Another approach is simply to observe a smaller area to a fainter 
magnitude limit, thus increasing Nq/A. Either strategy improves the survey's sensitivity 
to geometrical distortion (at the cost of longer spectroscopic exposures), provided that the 
clustering measurements remain in the sparsely sampled regime, N c <^ 1. Once N c exceeds 
one, new quasar pairs contribute partially redundant information, and there is more to be 
gained by expanding the survey's area or redshift range. (This statement applies only to 
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the two-point correlation function and its relatives; clustering measures that are sensitive 
to higher-order correlations would continue to benefit from denser sampling.) 

As an illustration, we repeat the tests of Figures 5-8 for a hypothetical high density 
quasar survey (HDS), now returning to the smaller quasar correlation length implied by 
equation ([34]). We assume a sample of 30,000 quasars in 200 square degrees — the same 
Nq as 2dF, but a surface density 3.25 times higher, and F(z) identical to the one of 2dF. 
The Sloan southern stripe quasar survey might provide such a sample if quasars can be 
identified and their redshifts measured to a sufficiently faint limiting magnitude. Figure 9 
shows that even with the small correlation length, the high-density survey allows strong 
rejection of models with incorrect geometry in all realizations with Qq =0.1 or 0.2 and in 
most realizations with Q Q = 0.4. 

Although we have focused mainly on the sensitivity of planned surveys to Qo and Ao, 
we should note that in our experiments the 2dF and SDSS samples constrain 7 and to 
at least 10% accuracy, with typical accuracy of about 5%. In the cases with a high quasar 
correlation length or a high-density quasar survey, the maximum-likelihood estimates 
achieve 2-3% accuracy in recovering 7 and 1-3% accuracy in recovering sq. We can thus 
expect these future surveys to provide precise measurements of the basic parameters 
characterizing the quasar correlation function. 

5. Discussion 

Our results from §4.4 show that the ambitious quasar redshift surveys planned by the 
2dF and SDSS teams can make important contributions to the study of the geometry of 
spacetime. In the case of flat cosmological models, some constraints on Q can be obtained 
even for the SB correlation length, and these constraints become interestingly tight for a 
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high-density quasar survey or for the 2dF and SDSS if the correlation length is a factor of 
two larger than SB's estimate. Clustering anisotropy does not provide useful constraints on 
Qo in open models because the distortion parameter h(z) is insensitive to Qo , and there 
is a near degeneracy in h(z) between an open model with low Q and a flat model with 
a higher Q . The true power of the clustering anisotropy technique comes into play if 
Qq itself is determined independently by dynamical methods. Clustering anisotropy then 
provides a tool for discriminating between open models with Ao = and flat models with 
Ao = 1 — , a distinction that is difficult to achieve with dynamical methods alone. We 
find that clear discrimination between flat and open geometries is possible for the 2dF and 
SDSS samples with the SB correlation length if Q < 0.2, but the discrimination is only 
marginal for Q = 0.4. The high-density survey with the SB correlation length or the 2dF 
or SDSS for double the SB correlation length provide clear discrimination for f2 = 0.4. 

The results in Figures 5-9 look fairly promising, but there are some limitations in 
our numerical experiments. For example, we assumed no evolution in 7 and a fixed form 
of Sq(z) (corresponding to no comoving evolution for Qq — 1, A = 0), so that we could 
produce one global fit to the clustering and cosmological parameters using all of the data. 
In the real universe, one will have to allow for the possibility of different evolution of the 
correlation function parameters. The maximum-likelihood method described in §4.3 adapts 
easily to this if the evolution can be described in a parametrized form, but because there 
can be some tradeoff between different effects, adding new parameters will weaken the 
constraints on Q and Ao- Also, as we have already noted, our assumed values of s and 
7, while plausible, are highly uncertain. If s and 7 turn out to be larger than we have 
assumed, then the statistical power of the clustering anisotropy test will increase; if smaller 
it will decrease. 

Probably the most important element missing in our analysis is the effect of peculiar 
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velocities, since small scale velocity dispersions and large scale coherent flows can both 
induce an angular dependence in £(s, //). To a first approximation, the small-scale dispersion 
has the effect of convolving the correlation function along the line of sight with the pairwise 
velocity distribution function (Davis & Peebles 1983; see also Fisher 1995). This causes a 
large distortion of the correlation function for galaxies at z — 0. However, if s = 0.01 at 
z = 2, then the velocity scale corresponding to the correlation length is 0.01c = 3000 kms -1 . 
The dispersion velocity of quasars is unknown, but a plausible value is ~ 300 kms -1 — the 
velocity dispersion of typical galaxy group. The width of the distribution function is thus 
very small compared to the correlation length, so for pairs separated by ~ sq, the distortion 
due to small scale dispersion should be small. 

Coherent large scale motions pose a potentially more serious problem. As a rough 
gauge of the importance of those velocities in confusing geometrical distortion, we can 
estimate the ratio of £(s, l)/£(s, 0) resulting from geometry and from linear theory peculiar 
velocities. For the surveys that we have considered, most of the geometrical information 
comes from the redshift z ~ 2, so we will take this value as the fiducial one. For typical 
cosmological models, h(z) ~ 2 at z = 2, which means that £(s, l)/£(s, 0) ~ 3.5 for 
geometrical distortions alone (see equation In conventional notation, 

P**-g- ( 39 ) 

is the linear theory ratio of peculiar velocity convergence —V ■ v pec / H to the galaxy density 
contrast, where b is the bias parameter relating galaxy and mass fluctuations. If /3 <C 1, 
then equations (10) and (11) of Hamilton (1992) allow us to write 

«flii = l ^— (40) 

«s,0 3-7+20 



We justify equation (f40|) in appendix A and argue that the typical value of (3 (assuming the 
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SB quasar correlation length) is ~ 1/6 in open, flat, and Einstein-de Sitter cosmological 
models. With 7 = 1.8, the ratio (HO) then becomes 



jf4 - 0.6 (41) 
0) 

Thus, the effect of coherent peculiar velocities by no means overwhelms the geometric 
signal, but it is not negligible. Analyses of real data will have to fit jointly for peculiar 
velocity distortions and geometrical distortions, using their different angular and redshift 
dependences to separate them. The results of Ballinger et al. (1996), Matsubara & Suto 
(1996), and Nakamura et al. (1997) provide important steps towards this goal, though it is 
not clear whether the linear theory formula for velocity distortions will be adequate near 
£ ~ 1 . A suitably parametrized description of peculiar velocity distortions can easily be 
incorporated in the maximum-likelihood scheme. The geometrical distortion is weakest 
in the models with low values of h (low Qq , high Ao models). However, these are also 
the models for which open and flat geometries are most easily distinguished, so there is 
good reason to believe that such distinctions will remain possible even when the effects of 
peculiar velocities are taken into account. 

There are other routes to measuring or limiting the cosmological constant. Probably 
the most solid existing limits come from the statistics of gravitational lensing (see, e.g., 
Carroll, Press, Sz Turner 1992; Maoz & Rix 1993; Kochanek 1996). These limits are 
somewhat dependent on assumptions about the evolution of the galaxy population (Rix et 
al. 1994), but current results present a strong case that Ao < 0.8. A promising approach on 
the horizon is the application of the classical magnitude-redshift test to calibrated candles 
in the form of high-redshift, Type la supernovae (Perlmutter et al. 1997). This technique is 
technically challenging, since one must guard carefully against differential selection biases 
between low- and and high-redshift samples, but if these obstacles can be overcome it is one 
of the most powerful methods for constraining Aq • This approach relies on the plausible 
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but not incontrovertible assumption that the luminosities of Type la supernovae do not 
change systematically over the age of the universe (see von Hippel, Bothun, & Schommer 
1997). High-resolution maps of the cosmic microwave background, such as those expected 
from the MAP and Planck surveyor satellites, offer another promising route to constraining 
A , along with a host of other cosmological parameters (see, e.g., Bennett et al. 1995 and 
Jungman et al. 1995), at least in the context of cosmic inflation models. It is not yet clear 
which of these approaches will ultimately yield the best constraints on the cosmological 
constant, but the existence of four essentially independent methods, all of them able to 
produce interesting results in the next 5-10 years, is very encouraging. Either they will all 
yield consistent answers, in which case they provide not just a convincing constraint but a 
consistency test of the underlying cosmological picture that motivates them, or they will 
not, in which case they point to a breakdown in the implicit assumptions behind one or 
more of the methods. 

As an extension of this last point, we note that all of our 2dF and SDSS realizations 
in Figure 5 are inconsistent at the > 2a level with the Euclidean, Ao — 1, flo =0 model 
even for a flat geometry with Q as low as 0.1 — and the inconsistency is much stronger 
for higher Q , a higher quasar correlation length (Figures 7 and 8), or a higher density 
quasar survey (Figure 9). These results imply that the geometrical distortion described in 
§2 should be detected by these surveys, even if the discrimination between flat and open 
space geometries is weak. This distortion is a fundamental property of the cosmological 
spacetime curvature predicted by General Relativity. If the universe is as we believe it 
to be, this signature of curved spacetime should be detected within the next decade, and 
perhaps within the next few years. 

We thank Jim Gunn for seminal discussions at the outset of this project. We thank 
Heidi Newberg, Brian Yanny, Don Schneider, and other members of the SDSS Quasar 
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A. The value of the coherent flow parameter (3 

Hamilton (1992) gives the linear theory distortions of £(s, /i) caused by peculiar 
velocities: 

£(s,/i) = Ur)PM +e 2 (r)P 2 (/i) +U*)PM ( A1 ) 

where Pi are Legendre polynomials and £o>£2 and £4 are defined in terms of the growth 
parameter f3 and the volume-averaged correlation function £(r) oc as 

Recall that /3 is defined as 

= (A5) 

For /3 <C 1, only the first two addends in ( |A1[ ) influence the result, since they contain terms 
proportional to (3 but £4 is proportional to (3 2 . Using the Legendre polynomial definitions 
Pq = 1 and P2 = 3m 2 ~ 1 and neglecting all the terms proportional to (3 2 , we find 

(A6) 



««,0)=(l + y-|){ (A7) 
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Dividing Q£§) by flXjJ yields 



£(s,0) (3 -7) + 2/3 



(A8) 



equation (HO) of the main text. 

For fio = 1, So = 0.01 at 2 = 2 corresponds to 6h _1 Mpc comoving, which happens to 
be roughly the correlation length of bright galaxies today. Observations suggest that these 
galaxies have (3 ~ 0.5, which implies a bias parameter 6 = 2 for Q =1. The linear mass 
fluctuations in an Q =1 universe scale with z as 1/(1 + 2), so the implied bias factor for 
quasars at z = 2 is b ~ 2(1 + z) ~ 6. Thus, 

(3(Q =l,A„ = 0)~i (A9) 



Now consider an open universe with Qq ~ 0.30. The comoving scale gso corresponding 
to So = 0.01 at z = 2 is, in this case, larger by a factor of about 1.5 than in the Qq = 1 
model. This implies that quasars are clustered more strongly than present-day bright 
galaxies by a factor of about 1.5 ~ 2. In an open universe, the ratio of the rms present-day 
mass fluctuation 00 to the rms fluctuation a(z) at redshift z is approximately 

a ° 1 + 25 °° • z. (A10) 



a(z) 1 + 1.5fi 

The bias parameter of galaxies is b ~ 1 at z = if Qq ~ 0.3, so the implied bias parameter 
for quasars at z = 2 is 

6-2-1 -4^7 = 4. (All) 

(T(Z) 



3 We choose Q = 0.3 to get some idea about both fl = 0.4 and Q = 0.2 cases. 
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At z — 2, the value of the density parameter Vt is 

n = + « 0.56. (A12) 

Putting these results together, we get (3 for quasars at z = 2 in a low-density, open universe: 

/3(Q = 0.3, A = 0) ~ ^Jl ~ 0.18. (A13) 



The analysis for a low-density flat universe with Q ~ 0.3 follows similar lines. The 
correlation length is larger by a factor of about 1.8 relative to the Q — 1 model. The 
ratio of mass fluctuations at z = 2 to fluctuations at z — 0, computed by the appropriate 
numerical integral, is 

2.38. (A14) 



a(z) 

The implied bias parameter for quasars at z = 2 is 

6~ 1.8 1 - 8 - 2.38 « 6.86. (A15) 
At z — 2, the value of Q is 0.92, and consequently 

/?(fi = 0.3, A = 0.7) ~ 0.14. (A16) 
In all three cases we find 

P({l ,\ ,z = 2)~±, (A17) 

so the assumption that j3 < 0.2 for quasars at z = 2 is fairly secure, unless the quasar 
correlation length is significantly smaller than the SB value (in which case detection of 
geometrical distortions of the correlation function may be rather difficult). 
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Fig. 1. — Geometry of an observer and a quasar pair in redshift space, with the distances s, 
sq and s z indicated. 

Fig. 2. — The distortion parameter h(z) as a function of redshift, for the indicated 
combinations of density parameter Q and cosmological constant contribution Ao- A 
cosmological model with Q — 0, A = 1 would have h(z) = 1 at all redshifts. 

Fig. 3. — The angular dependence of the correlation function for different values of the 
distortion parameter h. 

Fig. 4. — F(z) for 2dF (left panel) and SDSS (right panel) with superimposed dashed curves 
that correspond to models used in our simulations. 

Fig. 5. — Constraints on f2 for flat (f2 + A =1) cosmological models in simulations of 
the 2dF (left) and Sloan (right) quasar samples. Eight realizations (four for each survey) 
were generated for each value of Qq = 0.1, 0.2, 0.4, and 1. In all cases the true correlation 
function was characterized by 7 = 2, So(z = 0) = 0.002. Open squares show the maximum- 
likelihood estimates of fi ; error bars delineate the range of models with likelihood greater 
than 10% of the maximum likelihood. Filled circles are plotted in cases where an open model 
had a higher likelihood than the best-fit flat model. Small horizontal offsets are introduced 
for clarity. 

Fig. 6. — Relative likelihoods of flat and open models for simulations of the 2dF (left) 
and Sloan (right) quasar samples. Triangles represent flat models; i? -1 is the ratio of the 
likelihood of the true (flat geometry) model to the likelihood of an open model with the same 
value of Q and correlation function parameters. Circles show the corresponding comparison 
for intrinsically open models. For fi = 0.1 or 0.2, the incorrect geometry models can usually 
be rejected with 10:1 confidence or better. Small horizontal offsets have been introduced for 
clarity. 
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Fig. 7. — Constraints from simulations of the 2dF quasar sample for a high quasar correlation 
length, sq(z = 0) = 0.004 (r (z = 0) = l^h^ 1 Mpc). Left panel shows the ratio of the 
likelihood of a model with incorrect geometry to the true model, in the same format as 
Figure 6. Right panel shows constraints on fi for flat models, in the same format as Fig. 5. 

Fig. 8. — Same as Fig. 7, but for simulations of the Sloan sample. 

Fig. 9.— Same as Figs. 7 and 8, but for s (z = 0) = 0.002 (r (z = 0) = Qh^ 1 Mpc) and 
sample parameters of a hypothetical high-surface-density quasar survey, with 30,000 quasars 
in 200 square degrees. 
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